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Abstract 

We revisit the Dynkin game problem in a general framework, improve classical results and 
relax some assumptions. The criterion is expressed in terms of families of random variables 
indexed by stopping times. We construct two nonnegative supermartingales families J and 
J' whose finitness is equivalent to the Mokobodski's condition. Under some weak right- 
regularity assumption, the game is shown to be fair and J — J' is shown to be the common 
value function. Existence of saddle points is derived under some weak additional assumptions. 
All the results are written in terms of random variables and are proven by using only classical 
results of probability theory. 
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Introduction 

In this paper, the Dynkin game problem is revisited in the general framework of families of 
random variables indexed by stopping times. The criterion is given for each pair of stopping 
times (r, a) by 

/o (r, a) := ^[e(T)l|,^,| + C(fT)l{.<r}]. 

Studying the Dynkin game problem consists in proving that, under suitable conditions, the game 
is fair that is, 

inf sup Iq (r, a) = sup inf Jq (t, a) , 

(J ^ (J 

in characterizing this common value function, and finally in proving the existence of saddle 
points. 

Recall that this problem has been largely studied in the literature in the framework of 
processes. We mention, among others, Bismut (1979), Alario-Nazaret, Lepeltier and Marchal 
(1982). We stress on that this approach relies on sophisticated results of the General Theory of 
Processes and Optimal Stopping Theory. 
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Recently, Kobylanski and Quenez (2011) have revisited the optimal stopping problem in the 
case of a reward given by a family of random variables indexed by stopping times. This notion 
is very general and includes the case of processes as a particular case. This setup has appeared 
as relevant and appropriated as it allows, from the one hand, to release the hypotheses made on 
the reward, and on the second hand, to make simpler proofs using simpler tools. 

In the present work, the setup of families of random variables indexed by stopping times 
allows to solve the Dynkin game problem under very weak assumptions by using only classical 
tools of Probability Theory. 

The paper is organised as follows. In section 1, we introduce the Dynkin game problem. In 
section 2, we construct two [0, +oo]- valued supermartingale families J and J'. In the case of 
processes, this construction is classical (see for example Alario-Nazaret, Lepeltier and Marchal 
(1982)) and is done under the so called Mokobodski's condition on ^ and (. In the present work, 
we do not need any condition of this type in order to define J and J' . Mokobodski's condition 
then appears to be equivalent to the fact that J(0) or J'(0) is finite. In this case, J(0) — J'(0) is 
well defined and naturally appears as the common value function candidate. In section 3, when 
J(0) < +00, under the assumption that the families ^ and —( are right-upper semicontinuous 
along stopping times in expectation, the game is shown to be fair and the common value function 
is proven to be equal to J(0) — J'(0). In section 4, under some additional assumptions, we derive 
the existence of saddle points. At last, comes the Appendix where, in the first part, we briefly 
recall some results of Kobylanski and Quenez (2011) which are used in this paper and, in the 
second part, we provide two lemmas used to prove the existence result. 

We point out that, whereas in the previous works, the proof of the existence of saddle points 

relied on some highly sophisticated tools of the General Theory of Processes, the one given 
in this paper does not require any prerequisite and is only done by using classical probability 
results. 

We introduce some notation. Let F = {f2,T, {Ft) o^t^T, P) be a probability space equipped 
with a filtration {Ft) osit^T satisfying the usual conditions of right continuity and augmentation 
by the null sets F = Ft- We suppose that Fq contains only sets of probability or 1. The time 
horizon is a fixed constant T in ]0,oo[. We denote by T the collection of stopping times of F 
with values in [0, T]. More generally, for any stopping times S, we denote by Ts (resp. Ts+) the 
class of stopping times 6 eT with 6 ^ S a.s. (resp. 6 > S a.s. on {S < T} and 6 = T a.s. on 
{S = T}). 

We also define Tj^g ^'j the set of 9 eT with S ^ 9 ^ S' a.s. 

We use the following notation: for real valued random variables X and X„, n G N, "X^j X" 
stands for "the sequence (Xn) is nondecreasing and converges to X a.s.". 

1 Dynkin games 

In this section, we present the Dynkin game problem in the framework of families of random 
variables. 

Definition 1.1 — A family of M- valued random variables (f> = {4>{9),9eT) is said to be 
admissible if it satisfies the following conditions 

1) for all ^ G T (p{9) is a J"0-measurable random variable (r.v.), 

2) for all 9, 9' e T, ^{9) = (f>{9') a.s. on {9 = 9'}. 
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Remark 1.2 — Recall that the notion of admissible families is very general and includes the 
case of processes as a particular case. Indeed, if {(l)t)t£R+ is a progressive process, the family of 
random variables {4){9),9 G T) defined by (l){9) = (pe is admissible. 



An admissible family {(j){9), 9 £ T) satisfying E[esssupg^j- (p{9) ] < +00 is said to be a 
supermartingale family (resp. a martingale family) if for any 9,9 G T such that 9^9 a.s.. 



E[m\J'e']'^^i(^') a.s., (resp. i?[0(0) | -F,'] 



) a.s.) 



Let (f) = {4'{9), 9 £ T) be an admissible family and let t, a £ T such that t ^ a a.s. The 
family (^0(0), 9 G T[r,cr]j is said to be a martingale family if ^(/>((0Vr) Act), 9 G is a martingale 
family. 

In order to simplify notation, we say that two admissible families (p = {4'{9), 9 £ T) and 
^' = {(jj'{9), 9eT) satisfy (/> ^ if, for each 9 e T, ^{9) ^ (l)'{9) a.s. Similarly, we define the 
relations ^ and =. 

Concerning the optimal stopping problem in this general framework, we refer the reader to 
Kobylanski and Quenez (2011). The main results are recalled in the Appendix. 

We now introduce the Dynkin game problem. 
Let = {^{9) , 9 £ T) and ( = [C,{9),9 G T) be two admissible families satisfying: 



E 



ess sup [S,{9)y 



< +CXD and E 



ess sup (C(^)) 



< +00, 



(1) 



and we suppose that i{T) = C(^) = a.s. This condition is not really a restriction (see below 



Remark 1.5 1 . 



We consider the following game with two players. The rule of the game is as follows. Each of 
the players has to choose a stopping time, denoted by r for the first player and a for the second 
one. The game stops at r A cr. On {r ^ o"}, the second player pays the amount ^(r) to the first 
one and on {a < r}, the first player pays the amount — C(£'') to the second one. In other words, 
at time t A a, the first player receives the payoff C(t)1|^<jo-} + C(<7)l{(T<r} the second one 
receives the opposite amount. 

At time 0, the main of the first (resp. second player) is to maximize the expectation of his 
payoff. More precisely, if the second player has chosen to stop at time a, the first one wants 
to maximizes over r the quantity /q (r, a) := £'[^(r)]l|T-^o-} + C('7)1{(t<t}]- If the first player has 
chosen to stop at time r, the second one wants to minimize over a the quantity Iq (r, a). Now, 
the players are unwilling to risk. Thus, the first one wants to find a strategy r which maximizes 
the quantity info- -^0 {t, a) and the second one wants to find a strategy a which minimizes the 
quantity sup^ Iq (t, a). 

By making the problem dynamic, we thus are led to introduce for each 9 £ T, for each (r, a) 
G 7^, the criterion at time 9 is defined by: 



le (r, a) := E [^{T)l{,^,y + C{cT)t{a<r} I J'e 



Also, the first value function at time 9 is given by 

V{9) := ess sup ess inf Ig (r, a) 



(2) 



(3) 



which corresponds to the best gain the first player can expect when faced to a wise partner. 
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Also, the second value function at time 9 is given by 

V{9) := essinf ess sup (r, a) , (4) 

which corresponds to the least lost the second player can expect. 
For each 9 £ T, the inequality Y{9) ^ y{9) a.s. clearly holds. 

The game is considered to be fair if y{9) = V{9) a.s. and this quantity is then refered as 
the common value function. 

We now introduce the following definition. 

Definition 1.3 — Let 9 £ T- A pair (t, o") £ Tg is called a 9-saddle point if, for each 
(r,a)G V: 

h {r, a) ^ le (f, <t) ^ Ig{f, a) a.s. (5) 

In the study of the Dynkin game problem, the first object is to provide some sufficient 
conditions under which the game is fair and, in this case, the characterization of the common 
value function. The second one is to address the question of the existence of saddle points. 

Remark 1.4 — By classical results on game problems, for each 9 G T, a pair (f, a) is a ^-saddle 
point if and only if Y{9) = V{9) a.s. and the essential infimum in Q and the essential supremum 
in ^ are respectively attained at a and f. Hence, if, at initial time 9, {f,a) is a ^-saddle point, 
then f is an optimal strategy for the first player and a is an optimal strategy for the second one. 

Remark 1.5 — First, one can easily prove that the assumption ^(T) = C(^) ^-s- is not 
restrictive because the criterion does not depend on the terminal cost C(^)- 

Second, the additional assumption that this common value is equal to is no more restrictive. 
Indeed, let ^ and C be two admissible families such that ^(T) = C(^) fi-S- (but not necessarily 
equal to 0). Let us prove that the associated Dynkin game problem reduces to a Dynkin game 
with terminal rewards equal to 0. Let us make the following change of variables: 

V^er, e{0):=m-nm\J'e] and C'W := - E [OT | -Fe] , 

(by supposing that the random variable ^(T) is integrable). We clearly have ^' (T) = (' (T) = 
a.s. and, for every 9 £ T and every (r, a) £ Tg, the associated criterion Ig (r, a) can be written: 

Ig (r, a)=E (r) + C' {a) 1|,<,| | -Fe] + E [^(r) | J^g] . 

The game problem thus reduces to the one associated to the costs ^' and C' ■ Also, if we suppose 
that 



E 



ess sup Ui9) - E [^(T) | ) < +oo and E ess sup (({9) - E [^(T) | 



< +0O, 



then, the new rewards ^' and (' clearly satisfy the integrability condition ([T|. 

2 Preliminary results 

In this section, we first provide the construction of two [0, +oo]-valued supermartingale families 
J and J' . In the case of processes, this construction is classical (see for example Alario-Nazaret, 
Lepeltier and Marchal (1982)) and is done under the so called Mokobodski's condition on ^ and 
We stress on that in the present work, we do not need any condition of this type in order to 
define J and J' . Mokobodski's condition then appears to be equivalent to the fact that J(0) or 
J'(0) is finite. Under this condition, J — J' is well defined and naturally appears as the common 
value function candidate. 
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2.1 Construction of J and J' 



For each 9 & T, set 

Jo{e) := and Jo(0) := 
and, let us introduce for each n G N, 

-^n+il^) := ess sup E [J^ (r) + ^(r) | J'e] , 

J'n+ii^) '■= esssupE [J„ (a) - ({a) \ , 

which are weh defined by the following lemma. 



(6) 
(7) 



Lemma 2.1 — For each n G N and each 9 ^T, the random variables Jn{0) and Jn{9) are well 
defined and nonnegative, namely [0, +oo]-valued. Moreover, the families Jn = {Jn{9)-, 9 £ T) 
and = {J^{9), 9 £ T) are admissible and satisfy 

Jn+i = T^iJ'n + and J'^^i = lZ{Jn - C), 

where TZ is the Snell envelope operator. In other words, the families Jn+i and J^+i are the 
smallest supermartingale families greater (almost surely) than Jn + £, and respectively Jn — C- 

Proof — Let us show this property by induction. First, it clearly holds for Jq and Jq since 
they are equal to 0. Let us suppose that for a fixed n G N, for each 9 £ T, Jn{9) and J'n{9) are 
well-defined M+-valued random variables. We then show that this property still holds for n + 1. 
Let 9 £T. Since, for every t ^Te, J^(t) ^ a.s.and, since by assumption ([T]), 



E 



ess sup {^{9))' 



< +00, 



the random variable Jn+i{9) is well defined by ([6|. Using (|6]), the induction hypothesis (non- 
negativity of J'n) and the equality ^(T) = a.s., we derive that 

Jn+i{9) ^ E [j; (T) + e(T) I J-e] ^ a.s. 

By similar arguments and since by assumption ([T]), 



E 



ess sup (C(^))' 



< -l-oo, 



we also have that J4+i(^) is well defined and nonnegative. Moreover, the admissibility property 
of the families Jn and can be proven by induction. By classical results (see the Appendix) , 
for each n, the families Jn+i and J'nJ^i are the smallest supermartingale families respectively 
greater (almost surely) than -|- ^ and Jn — C- The proof is thus complete. □ 



Lemma 2.2 — The sequences of families {Jn)n&i ('^n)neN '^'^^ (almost surely) non- 
decreasing. 

Proof — The property can be proven by induction. By the previous lemma, we have Ji ^ = Jq 
and J{ ^ = Jq. Let us now suppose that, for a fixed n G N*, we have J„ ^ Jn-i and ^ J'n~i- 
We then have 

n (4, + i)^n ( + e) and 7^ ( j„ - c) ^ 7^ ( - c) , 
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which leads to Jn+i ^ Jn and J'^^i ^ J'^- This concludes the proof. □ 

For each 9 £ T, let us define J{9) := limsup J„(0) and J'{0) = limsup J^(0). We clearly 
have: 

J{9) = lim t Jn{0) a.s. and J' (9) = lim t Jn{9) a.s. 

Note that the families J = {J{9), 9 £ T) and J' = {J' {9), 9 £ T) are clearly admissible and 
nonnegative (since, for each n G N, J„ and are themselves nonnegative) . 

Theorem 2.3 — Let ^ and ( be two admissible families satisfying integrability condition ([Ip 
with ^(T) = C(^) = The associated families J and J' are then nonnegative supermartingale 
families which satisfy J = 1Z (J' + and J' = TZ{J — Q) that is, for each 9 € T, 

J(6I) = ess sup E [J' (r) +^(t) it's] a.s., (8) 

r&Te 

J'(6') = ess supE[ J (a) - C(o-) I -Fe] a.s. (9) 

Moreover, J and J' are minimal in the following sense: if H and H' are two nonnegative 
supermartingale families such that H H' + ^ and H' ^ H — Q, then we have J ^ H and 
J' ^ H'. 

Remark 2.4 — From the second assertion of the above theorem, it clearly follows that J and 
J' are the minimal nonnegative supermartingale families which are solutions of the system 



and 
and 



. More precisely, if J and J' are two nonnegative supermartingale families satisfying 
that is, J = 7^ ( J' + and J' = 7^ ( J - c) , then we have J ^ J and J' ^ J'. 



Before giving the proof of this above theorem, we first show that the limit of a non decreasing 
sequence of nonnegative supermartingale families is a supermartingale family. More precisely, 
the following lemma holds. 

Lemma 2.5 — For each n £ N, let 4>n ■= {4)n{9),9 G T) be a nonnegative supermartingale 
family. Suppose that the sequence {4'n)n&i is non decreasing that is, for each n S N and each 9 
e r, (t)n{9) ^ (t)n+i{9) a.s. 

The family (p = {(j){9), 9 £ Tq) defined for each 9 G T by (j){9) := limsup^^^^ 0„(6') is then a 
nonnegative supermartingale family. 

Proof — One can easily prove that (j) is an admissible family. Let us prove that it is a 
supermartingale family. Let 9,9 G T be such that 9^9 a.s. By the monotone convergence 
theorem for the conditional expectation, we get 

E[(f){9') I J^e] = hm t E[MO') I ^e] ^ Hm t MO) = m a.s., 

where the inequality follows from the supermartingale family property of (j)n, for each n. □ 



Proof of Theorem 2.3 — From Lemma 2.5, since J and J' are the limit of non-decreasing se- 
quences of nonnegative supermartingale families, they are nonnegative supermartingale families. 
For each n G N, we have: 

= 7^ ( j; + e) ^ 7^ ( J' + . 

By letting n tend to -|-cxd, we get that 

J < 7^ ( J' + e) . (10) 
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Now, for each n G N, Jn+i ^ + By letting n tend to +00, we derive that J ^ J' + ^■ 
By the supermartingale property of J and the characterization of TZ (J' + ^) as the smallest 



supermartingale greater than J' + ^, it follows that J ^ TZ{J' + £,). This with (10 1 yields that 
J = TZ[J' + £). By similar arguments, one can easily derive that J' = TZ{J — C)- 

It remains to show the second assertion. Let H = {H{6))q^j- and H' = {H'{6))q^j- be two 
nonnegative supermartingale families such that H ^ H' + and H' ^ H — Q. Now, the following 
lemma holds. 

Lemma 2.6 — For each n E'N, Jn ^ H and ^ H' . 

By letting n tend to +00 in the previous lemma, we get that J ^ H and J' ^ H' , which 



ends the proof of Theorem 2.3, □ 



Proof of Lemma 2.6 — Let us show the result by induction. It clearly holds for Jq and Jq. Let 
us suppose that, for some fixed n G N, Jn ^ H and ^ H' . 

Let 9 £ T. By using the induction hypothesis, the inequality H ^ H'+£_ and the supermartingale 
property of -ff, we have, for each t £ To, 

E [J'n (r) + e(r) I -Fe] ^ E [H' (r) + ^(r) \Te]^^ [H (r) | J^e] ^ H{9) a.s. 

By taking the essential supremum over t £ Te, we derive that Jn+i(^) ^ H{9) a.s. 

By similar arguments, we also get that Jn+i{(^) ^ ^-s- ) which completes the proof of 

Lemma 12.61 □ 



Note now that since J ^ J' + ^ and J' ^ J — it follows that J(0) < +00 if and only if 
J'(0) < +00. 

2.2 Mokobodski's condition 

Suppose now J(0) < +00. We can then define the admissible family Y by 

y := J - J', 

and we have 

C^y^C- (11) 

In particular, if J(0) < +00, then for each 9 £ T, (,{9) ^ (^{9) a.s. In other words, if there exists 
iy£T such that P {^{u) > ({u)) > 0, then J(0) = J'(0) = +00. 

Moreover, by the second assertion of the previous theorem, the property J(0) < +00 is 
equivalent to the existence of two nonnegative supermartingale families H and H' such that 
H ^ H' + S, and H' ^ H - ( with H{0) < +00 (or equivalently with H'{0) < +00). In other 
words, we have 

Proposition 2.7 — The following assertions are equivalent: 

• J(0) < +00; 

• J'(0) < +00; 

• Mokobodski's condition holds that is, there exist two nonnegative supermartingale families 
H and H' with H(0) < +00 (or equivalently with H'{0) < +00) such that 

^ ^ i7 - ^ C- 

Remark 2.8 — If for example, ^ ^ ^ Ci Mokobodski's condition is then satisfied with 
H = H' = (= J = J') and we clearly have V = V = 0. 
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2.3 A sufficient condition to solve the Dynkin game problem 



Under the above condition, J — J' is well defined and naturahy appears as the common value 

function candidate. 

We have the following property. 

Proposition 2.9 — Suppose that J(0) < +00. Let 6 & T and let (f , a) £ be such that f is 
optimal for J{0), that is 

J{e) = ess sup E [J' (r) + ^(r) | J^e] = E [/(f) + ^(f) | Fe] a.s., 

and a is optimal for J'{0), that is 

J' {9) = esssupE [J((t) - C{(t) | -Fe] = E [J{a) - C{a) \ Te] a.s. 

Then, the game is fair, the common value function is equal to Y(9)(= J{0) — J' {9)) and {f,a) 
is a 9-saddle point. We thus have 



Y{9) = y{9) = V{9) = h{T,a) a.s. 



(12) 



Remark 2.10 — Note that if ^ is a supermartingale family, then for each 9 G T, {9,T) is a 
6'-saddle point. Indeed, for each (r, cr) E Tq , 

Ie{9,T) = Ie{9,a) = E[m\^e]=m a.s., 

and Ig{T,T) = E[^{t) \ Tg] ^ ^(6*) a.s. and the common value function is equal to ^ (without 
any condition on ("). Hence, if aditionnaly, there exists v £ T such that P {^(i/) > C(^^)) > 0; 
then J(0) = +00 (by (|11[)) even if for each 9, a 0-saddle point does exist. 

This example shows that condition J(0) < +00, or equivalently Mokobodski's condition, is 
not necessary to have the existence of saddle points. We even have that the weaker condition 
^ ^ C is not a necessary condition. 

Proof — Let 9 £ 1~. By the optimality criterion (see (22 ) in the Appendix), (^J{t), t E T[e,f]j is 

a martingale family and J(f) = J' {f)+^{f) a.s. , that is ^(f ) = ^(f) a.s. Also, ^ J'(cj), a G 'T[e^a]j 
is a martingale family and J' [a) = J(o") — C(<7) a.s. that is Y[a) = C,[a) a.s. Since Y = J — J' , 
it follows that {Y{a), a € T\0^f/\a]j is a martingale family and hence that 

Y{9) = E [y (f A <7) I J-g] = E [y(f)l|^^^| + y(a)a{^<^| | Fe 



E 



+ C(o")l{a<f} I /e =h{T,d) a.s. 



Let us now show that, for each a GTe, Y{9) ^ Iq (f, cj) a.s. Let a gTq. Since (^J(t), t G T[g^ 
is a martingale family and J' is a supermartingale family, it follows that y = J — J' is a 
submartingale family on [9,f Aa], which ensures that: 

Y{9) ^ E [y (f A a) I J-e] ^ E [mhi^a} + C(c^)l{a<f} I J'e] = le (f , a) a.s., 

where the second inequality follows from the fact that Y{f) = ^(f) a.s. and Y {a) ^ C((t) a.s. By 
similar arguments, one can show that, for each t & Te, le ij, a) ^ Y{9) a.s. We have thus proved 
that (f, a) is a ^-saddle point for J and that equalities (|12[) hold. □ 
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Remark 2.11 — - Let J and J' be two nonnegative supermartingale families satisfying integra- 
bility conditions and such that J = TZ {^J' + ^ and J' = TZ (^J — . The same proof shows 
that the above property still holds for J and J' . 

More precisely, if J(0) < +00 and if, for some 6 ^ T and {f,a) G 7^, t is optimal for J {9) and 
a is optimal for J'{0), then (r, it) is a 0-saddle point and we have: 

J{e) - J'{9) = Y{9) = Y{9) = V{9) a.s. 

In particular, we have J{9) — J'{9) = J{9) — J'{9) a.s. 

3 Existence and characterization of the common value function 

Let us now introduce the following definition. 

Definition 3.1 — An admissible family {(j)(9),9 £ T), satisfying E[esssupg^-f (f){9)~] < +00 is 
said to be right- (resp. left-) upper semicontinuous in expectation along stopping times (right- 
(resp. left-) USCE) if for all 9 G T and for all sequences of stopping times such that 9"- I 9 
(resp. 0" t 0) 

E[4>{9)] ^lim sup E[^{9n)]. 

n— >oo 

Theorem 3.2 — Suppose that J(0) < +cx) and that the families {^{9), 9 e T) and {—({9), 9 £ 
T) are right-USCE. Then, the game is fair and the common value function is equal to Y{= J— J') 
that is, for each 9 G T, 

Y{9) = V{9) a.s. (13) 

Proof — Let 9 G T. For each A g]0, 1[, we introduce 

T^{9) := ess inf{ t G Te , \J{t) ^ J'(t) + ^(r) a.s. }. 

and 

a^{9) := essinf{ aGTe, AJ'(a) ^ J {a) - Q{a) a.s. }. 



Recall that (see (25) in the Appendix), t [9) (resp. cr [9)) is (1 — A)-optimal for J{9) (resp. 
J' {9)). In order to simplify notation, in the sequel, t^{9) (resp. cr^{9)) will be denoted by 
(resp. cj'^). Now, the following lemma holds. 

Lemma 3.3 — For each A G ]0, 1[ and each (cr, r) G Tq , we have 

I,{r,a^)-{l-X)J'{9) ^ Y{9) ^ Ie{T\a) + {1 - \)J{9) a.s. 



We postpone for a while the proof of this lemma and complete the proof Theorem 3.2 
We clearly have that V^{9) ^ V{9) a.s. Hence, it is sufficient to prove that 

V{9) ^ Y{9) ^ V{9) a.s. (14) 

Now, the previous lemma yields that for each A G ]0, 1[, 

esssup/e(r,cj^) - (1 - A)J'(0) ^ Y{9) ^ ess inf /^(r^, cj) + (1 - A) J(e) a.s. , 

which implies that 

V{9) - (1 - X)J'{9) < Y{9) ^ V{9) + (1 - X)J{9) a.s. 



9 



By letting A tend to 1, we get inequalities (14|. It follows that V{9) = Y{9) = y^{9) a.s. , and 
completes the proof of Theorem |3.2[ □ 



It remains to prove Lemma 3.3 which actually shows that (a , r ) is an (1 — A)-saddle point. 
Proof of Lemma 3.3 — First, one can easily show that each supermatingale family is right- 
USCE. Hence, since J and J' are supermartingale families, they are right-USCE and so are J — C 
and J' + ^ because ^ and — C are right-USCE. 

Recall now that (see (24) in the Appendix), [J' {a), a £ ^[6»,cr^] ) is a martingale family. Hence, 
since J is a supermartingale family, it follows that y = J — J' is a supermartingale family. We 
thus have 

Y{e) ^ E[Y{a^ A r) | Jg] ^ E[Y{T)t,^,x + y(a^) V<r I J'e] a.s. (15) 



Recall now that Y ^ ^. Moreover, thanks to inequality (23) in the Appendix, we have the 
following inequality XJ'{a^) ^ Jio'^) — Ci'^'^) a.s. , which can be written 



y(CT^) ^ Cia^) - (1 - A) J'(ct^) a.s 



This with inequality ( 15 ) leads to 

Y{9) ^ E[C{t)K^,, + C(^7^)I1.A<, I J^e] - (1 - X)E[j'{a^)l,.^, \ J",] a.s. 
The supermatingale property of J' yields that 

E[J'{a^)l,,^, I J^e] ^ E[J'{a^) \ Jg] ^ J'{9) a.s. 
This with the previous inequality and the definition of /^(t, o"'^) leads to 

Y{9) ^ Ie{T,a^) - (1 - X)J'{9) a.s. 
By the same arguments, one can show the following inequality: 

Y{9) ^ /e(r\a) + (1 - A)J(0) a.s. 
The proof of Lemma 3.3 is thus complete. □ 



Remark 3.4 — Let J and J' be two nonnegative supermartingale families satisfying integra- 
bility conditions ( 1 ) and such that J = Tl(^J' + and J' = TZ {^J — . The same proof shows 
that the above property still holds for J and J'. 

More precisely, if J(0) < +oo and if ^ and -( are right-USCE, then Y{9) = J{9) - J'{9) a.s. 
and equalities (13) hold. 



3.1 The right-continuous in expectation case 

Let us now introduce the following definition. 

Definition 3.5 — An admissible family ((j)(9),9 £ T) is said to be right- continuous in expec- 
tation along stopping times (right- CE) if for all 6 S T and for all sequences of stopping times 
{9n) such that 0" i 9, E[(t>{9)] = lim„^oo E[(l){9n)]. 

We first show that the limit of a non decreasing sequence of right-CE supermartingale families 
is also an right-CE supermartingale family. More precisely, the following property holds. 
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Lemma 3.6 — For each n G N, let (j)n '■= {(j)n{0)-,G £ T) be a right-CE nonnegative super- 
martingale family. Suppose that the sequence {(j)n)neN ^'-^ non decreasing that is, for each n G N 
and each 9 £ T, 4>n{9) ^ a.s. 

The family (j) defined for each G T by (p{6) := limsup^^;^ (pn{d) is then an right-CE super- 
martingale family. 



Proof — By Lemma 2.5 , we already know that family (/> is a supermartingale family. It remains 
to show that it is right-CE. Let 9 £ T and let (9p) be a sequence of stopping times such that 
9^ 4 9. By the monotone convergence theorem and the right-CE property of <j)n, we have 

lim t E[(l){9p)] = lim t E[ lim t M^p)] 

= lim t lim t E[(j)ni9p)] = lim t Hm t E[M9p)] 

= lim t^[lim tMdp)]=E[m]- 

n— >cxD p— >-oo 

The proof is thus complete. □ 



Remark 3.7 — We stress on the simplicity of the proof. Note also that using the above lemma 
together with the well-known result of aggregation of right-CE supermartingales (see Th. 3.13 
in Karatzas and Shreve (1994)), one can easily derive the analogous result for processes (see Th. 
18 ch. VI in Dellacherie Meyer (1980) as well as their quite long proof, comparing to ours). 

Proposition 3.8 — Suppose that J(0) < -|-cxd and that the families ^ and — C are right-CE. 
Then, the families J and J' are right-CE. Also, Y(= J — J') is the common value function of 
the saddle point problem and is right-CE. 

Proof — Recall that by a classical result of optimal stopping theory (see Lemma 2.13 in El 
Karoui (1981)), the value function associated with an right-CE reward family is right-CE. This 
ensures that by induction, for each n, J„ and are right-CE. Since J = limn-s-oo t Jn and 



J' = lim„^oo t JLi by Lemma 3.6 J and J' are right-CE. 

Moreover, by Theorem 3.2, since ^ and C are RCE and hence right-USCE, it follows that 
Y = = V that is, Y is the common value function of the saddle point problem. Also, 
since y = J — J', it is right-CE. □ 



4 Existence of saddle points 



Under additional assumptions, we provide an existence result. 



First, by similar arguments as those used in the proof of Proposition 2.7 we have 



Proposition 4.1 — Let ^ and C, be two admissible families satisfying integrability conditions 
(^. The following conditions are equivalent 

• The family J is of class T>. 

• The family J' is of class T>. 

• The strong Mokobodski condition holds that is, there exist two nonnegative supermartin- 
gale families H and H' of class T) such that 
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We now introduce the following definition. 

Definition 4.2 — An admissible family [(f){9),6 G T), satisfying i?[esssupgg-7- (0(^)) ] < +c« 
and of class P, is said to be strongly left-upper semicontinuous along stopping times in expectation 
(strong left-USCE) if for all 6 £ T, for all F £ Tq- and for all non decreasing sequences of 
stopping times (^n)n6N such that 0" t 0, 

limsup£;[(/>(6l„)]lF] ^ S[(/)(6I)1f]. (16) 

n— ^-oo 

Remark 4.3 — Note that in this definition, no condition is required at a totally unaccessible 
stopping time (such as, for example, a jump of a Poisson process). Indeed, suppose that is a 
totally unaccessible stopping time. Then, if {dn)n&\ is a non decreasing sequence of stopping 
times converging to ^, it is necessarily a.s. constant equal to d from a certain rank. Using the 
integrability conditions and Fatou's lemma, we get 

limsup£;[0(6'„)lir] ^ £^[limsup(/>(6l„)li;'] = E{<^{e)\F\. 



Hence, inequality (16) is always satisfied for any F G J~e~. 

In the particular case of an optional process (</>*), the strong left-USCE property of the family 
((^61, G T) is thus weaker than the usual left-upper semicontinuity property of the process ((/)j). 

We provide the following regularity result. 

Theorem 4.4 — Let ^ and ( be two admissible families satisfying integrability conditions ^ 
and such that the families J and J' are of class T). Suppose that for each predictable stopping 
time T £ T with r > a.s. 

{e(T) = C(r)} = a.s. (17) 
If and — C are right-USCE and strong left-USCE, the families J and J' are then left-USCE. 

This theorem together with Proposition |2.9| and the existence result for optimal stopping 
time problem (see (26) in the Appendix or [9^) provides the following general existence result. 

Corollary 4.5 — (Existence result) Suppose that the assumptions of the above theorem hold. 
For each 9 £ T, the stopping time 

n{9) :=essinf{r G Te , J{t) = J'(r) + ^(r) a.s.}. 

is an optimal stopping time for J{9) and 

a^{9) := essinfj a £ Te , J' {cr) = J{cr) — C,{a) a.s. }. 

is an optimal stopping time for J'{9). Moreover, the pair (r*(0), (T*(^)) is a 9-saddle point for 
the criterion Ig and 

Y{9) = V{9) = V{9)=Ie{M9),a49)) a.s. 

Remark 4.6 — Let us consider the particular case where the families ^ and C are given by 
predictable processes (^j) and (Ct)- Then, by classical results on processes (see Dellacherie and 
Meyer (1975)), condition (17| is equivalent to the fact that P(^f = Q, Vt) = 0. Of course, this 
equivalence does not hold if (^t) and (Ct) are only supposed to be optional. Indeed, in general, 
in order to ensure that P(^t = Q, Vt) = 0, condition (17) must hold for any optional stopping 
time r. 
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Note also that our assumptions are weaker than those made in Alario-Nazaret, Lepeltier and 
Marchal (1982) (see section 2 p30). Moreover, their proof of the left-upper semicontinuity prop- 
erty of the processes J and J' (see Lemma 4-2 p30 in their paper) requires highly sophisticated 
results of the General Theory of Processes as, among others, the so called Mertens decomposi- 
tion of supermartingales and the existence of a left-upper semicontinuous envelope X for a given 
optional process X. On the contrary, the proof given below is only based on classical properties 
of Probability Theory. 



Before showing Theorem 4.4 we provide the following lemma. 



Lemma 4.7 — Suppose that for each predictable stopping time t €z T with t > a.s., equality 
is satisfied. Then, for each 9 G T and for each non decreasing sequence of stopping times 
{6n)n£n such that 6" f 6, we have 



{m = C{0)}n{en<e, for a//n} = 



a.s. 



4-7 — Let us introduce the set A := |6'„ < 9, for all n |. 
that 9 coincides on A with a predictable stopping time. Let r := lim„_).oo 



Proof of Lemma 
Let us first show 
and let 

for each n. The sequence (r^) announces its limit r everywhere on Q. In particular, r is 
predictable. Also, t = 9 a.s. on A. Hence, we get 

im = m} nA = {^(r) = C(r)} nAc {e(r) = C(t)} = a.s. , 

which provides the desired result. □ 



Proof of Theorem 4-4 — Let be a given stopping time and let (^n)neN be a non decreasing 
sequence of stopping times such that 0" t 9. Let us show that lim sup„_j.^oo E[J{9n)] ^ E[J{9)]. 

Let us A := {9n < 9, for all n}. Since for almost every uj £ A'^, the sequence {9n{uj)) is 
constant from a certain rank, it follows that the sequence (J(^n)(w)) is also constant from a 
certain rank. Indeed, note first that A^ := Up Cii^p {9i = 9}. Let p G N. By the admissibility 
property of Z, for each n p, J{9n) = J{9) a.s. on f\i^p{9i = 9}. Hence, lim„_>.oo J{9n) = J{9) 
a.s. on f\i^p{9i = 9} and this holds for each p. Hence, Mmn^oa J{9n) = J{9) a.s. on A^. 

Since the family J is of class P, we have lim„_j.+oo -£'[>^(^n)lA=] = E[J(9)1a'']- It is thus 
sufficient to show that 

lim sup £;[J((9n)M ^ E[J{9)1a]. 

ra— >+oo 

Since {9n) announces 9 on A, by the convergence theorem for nonnegative discrete super- 
martingales, the sequence (J(0n))„gN converges a.s. to a nonnegative random variable denoted 
by J{9~). Also, J{9^)1a is J^e- -measurable and, if (0^)„gN is a non decreasing sequence of stop- 
ping times such that 9'^ t 9, then lim„^oo J{Gn) — li™n-s>oo J{(^n) = J{(^~) a.s. on ^ n A', where 
A' := {9'j^ < 9, for all n}, as precised in the Appendix (see also Theorem 4.5 in Kobylanski and 
Quenez (2011) for more details). 

Similarly, there exists a nonnegative random variable which we denote J' {9^) such that 
lim„_>oo J'iGn) = J'{G~) a.s. This random J'{9^) satisfies similar properties as J{9~). 

Since the family J is of class P, we have lim^^+oo E[J{9n)'^A\ = E[J{9~)tA[- 
The problem thus reduces to prove that 

E[{J{9)-J{9-))Ia]-^Q. (18) 
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Let B := { E[J{e) \ Tg-] < J{9-) }. We have 

E[{J{9)-J{e~))lA] = E[{E[J{e)\Fg-]-Z{9~))lA] 

= E[{E[J{e)\Fe-]-Ji.O-))UnB\ 

= E[{j{e)-j{e-))iAnB\ 



Recall that for each p and for each A G [0, 1[, 9 {9p) < 9 a.s. on B f] A (see Lemma A. 3). 
Moreover, by Lemma |A.4[ 

E[J{9-)lAnB] = E[J\9-)lAnB]+ sup limsupE[^{r\9p))lAnB] 

Ae]o,i[ p^°° 

^ E[J'{9-)lAnB]+E[m^AnB], 
where the last inequality follows from the inequality 

lim sup E[aT\9p))lAnB] = limsup^[e(T^(^p) A 9)lAnB] ^ E[mUnB], 



due to the strong left-USCE property of ^ (see (|T6j)). It follows that 

E[{J{9)-Ji9-))lAnB] > E[{J{9)-J'{9-)-m)UnB]. 

Let B' := { E[J'{9) \ J^e-] < J'{9~) }. Suppose now that we have shown that 

AnBnB' = (!> a.s. (19) 

This yields that ACiBc {B'Y a.s. , which implies that 

E [J'{9) I Fe-] = J'{9") a.s. onAnB. 

Hence, 

E [{Ji9) - J(r)) Iahb] > E [{Ji9) - J'{9~) - m) W] 

^ E [{J{9) - J' {9) - i{9)) Ia^b] > a.s. , 

since J [9) ^ J' [9) + ^{9) a.s. Hence, J is left-USCE. By similar arguments, we have that J' is 
also left-USCE. 



It remains to prove (19). Let C := A f] B f] B . By Lemma A. 4 and since ^ is strong 
left-USCE, we have 

E[J{9~)lc] = E[J'{9-)ic]+ sup limsup E[^{T\9pmc] 

Ae]o,i[ 

^ E[J'{9-)lc]+E[m^c]. 
Similarly, since is strong left-USCE,, 

E[J'{9-)lc] = E[J{9-)lc]- inf limini E[C{a\9p))lc] 

Ae]o,i[ 

^ E[J{9')tc] - E[a9)lc]. 
By adding the two above inequalities, we get 

^ E[a9)lc] - E[C{9)lc], 

which, with the inequality C{9) ^ ^(0) a.s. , leads to ^(0) = C{9) a.s. on C. Since, by Lemma 
[47l {^{9) = C{9)} n ^ = a.s. , it follows that P{C) = 0. The proof of Theorem [O] is thus 
complete. □ 
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A Appendix 



A.l Some results on optimal stopping in the framework of families of random 
variables 

Let ((j){6),6 £ T) be an admissible family called reward satisfying the following integrability 
condition: 

^[esssup(/)(6')"] < +00. (20) 
eer 

For 5 G To, the value function at time S is given by 

v{S) = ess sup E[<j){e) \Fs]. (21) 
e&Ts 

This optimal stopping problem clearly reduces to the case of a nonnegative reward, which 
has been studied by Kobylanski and Quenez (2011) in the framework of families of random 
variables. 

More precisely, define X[6) := E'[ess sup^g-7-g 0(t)^ | J^q] and (f){9) := (j)(9) + X{6). This new 
reward (p is nonnegative and the associated new value function v satisfies v(6) = v{6) + X{9) 
a.s. By translation, all the properties satisfied by the new value function v are thus satisfied by 
the value function v. 

First, u is a supermartingale family and is characterized as the Snell envelope family asso- 
ciated with the reward family cj) that is, the smallest supermartingale family which is greater 
(a.s.) than (j). 

In the sequel, we denote by TZ the Snell envelope operator defined on the set of admissible 



families satisfying condition (20) and valued in the set of supermartingale families. For each 



admissible family (f) satisfying (20), 'R.{4)) is the corresponding value function v or equivalently 
the associated Snell envelope family. 

Note also that if the family is of class T) (uniformly integrable), then is of class V. 

Let S £ T and let 9^: £ Ts he such that E[(j){9^:)] < 00. The stopping time 9^: is said to 
be 5-optimal if v{S) = E[(l){9^:) \J^s] a-s. The so called optimality criterion ensures that 9^ is 
S'-optimal if and only if 

v{9^) = (f){9^) a.s. and {v{9),9 £Tysfi^]) is a martingale family. (22) 

Recall the following results (proven in Kobylanski and Quenez (2011) section 2.1.). 
Suppose the reward (0(61), 6* G T) is right-USCE and w(0) < 00. Let 5 G T and A G ]0, 1[. The 
stopping time 9^{S) defined by 

9^{S) := ess inf { 9 £ Ts , Xv{9) ^ 0(0) a.s. } 

satisfies 

Xv{9^{S)) ^ 0(0^(5)) a.s. (23) 

and 

v{S) = E[v{9\S))\Ts] a.s. (24) 
Note that this equality is equivalent to the martingale property of the family {v{9), 9 £ T^s,e^{S)])- 



From ([231 and (|24j), it follows that 9^{S) is (1 - A)-optimal for v{S) that is, 

Xv{S) ^ E[(l){9^{S))\J^s] a.s. (25) 



15 



Moreover, under the additional assumption of left-USCE property of the reward (j), the 
(1 — A)-optimal stopping times 9'^{S) tend to an optimal stopping time for v{S) as A f 1- More 
precisely (see Kobylanski and Quenez (2011) section 2.2.1), for each S £ T, the stopping time 
e^S) defined by 

e^S) := ess inf{ 9 € Ts , v{e) = (p{e) a.s. } (26) 

is the minimal optimal stopping time for v{S). Moreover, ^*(5') = lim;^-|-i f 0'^(S') a.s. 

At last, recall some regularity results which are used in the proof of Theorem |4.4[ 
Note first that, without any assumption on the reward family, the value function is right-USCE 
because it is a supermartingale. 

For S in T. Suppose that S £ Tq+ that is, 5 > a.s. Note that, since J"o is the trivial 
c7-algebra augmented with the P-null sets, this condition is equivalent to P{S > 0) > 0. Recall 
that a non decreasing sequence of stopping times {Sn)neN such that for each n, Sn ^ S a.s. , is 
said to announce S on A C if 

SntS a.s. on A and Sn < S a.s. on A. 



We have the following property, which is used in the proof of Theorem 4.4 



Proposition A.l — Let {u{6), 9 £ T) be a supermartingale family satisfying £'[esssupgg7-u(0)^] < 

+ 00. 

Let S be a stopping time in Tq+. Suppose that S is accessible on a subset A of Q. 

There exists an J^g- -measurable random variable u{S~), unique on A (up to the equality a.s.), 

such that, for any non decreasing sequence {Sn)n&i announcing S on A, one has 

u(S^) = lim u(Sn) a.s. on A. 

n— s-oo 

If u{0) < +00, then u{S^)1a is integrable. 

Remark A. 2 — Recall that, by definition, the set A(S) of accessibility of S is the union of the 
sets on which S is accessible. By a result of Dellacherie and Meyer (Chap IV. 80), there exists a 
sequence of sets (Afc)fcgj^ in Tg- such that for each k, S is accessible on Af^ and A{S) = UkA^ 
a.s. It follows that u{S~) is well defined on A(S) and depends only on S. Actually, this property 
is not used in this paper. 

Proof — The proof is based on classical results of probability theory. Without loss of generality, 
we can suppose that u is nonnegative. Let (S'n)neN be a non decreasing sequence announcing 
S on A. It is clear that {u{Sn))n<^N is a discrete nonnegative supermartingale relatively to the 
filtration {J^s„)neN- By the well-known convergence theorem for discrete supermartingales, there 
exists a random variable Z such that {u{Sn))neN converges a.s. to Z. If n(0) < -|-cxd, then Zl^ 
is integrable. We then set u{S~) := Z. 

It remains to show that this limit u(S^), restricted to A, does not depend on the sequence 
{Sn). For this proof, one is refered to Kobylanski and Quenez (2011) Theorem 4.5. □ 



A. 2 Two useful lemmas 



We now provide two lemmas which are used in the proof of Theorem 4.4 , The proofs are based 
on classical results of probability theory. 

Suppose {(l){9),9 G T) is a right-USCE admissible family satisfying £'[ess sup^g-y- 0(^)^] < 
-|-oo and v{0) < oo. 
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Let 9 £ T and let (^p)pgN in T such that Op f 6. 

Suppose that the event A := {6n < 0, for ah n } is non empty and set B := {E[v(6) \ J^q-] < 
v{0~)}, where v = TZ{(j)). We provide the following result. 

Lemma A. 3 — For each p and for each A G [0, 1[, 0'^{9p) < 6 a.s. on B n A. 

Proof — For this, it is sufficient to show that for each p, B n An {0''^{Op) ^ 0} = a.s. 

Note first that {d^iOp) ^9} = nJ^^C^p) ^ Oq}. Hence, {e^{dp) ^ 9} e Tq- n V^J'e^. 

Also, for each g ^ p, E{v{Q^{ep)) \ J"eJ = v{dq) a.s. on {Q^iQp) ^ Qq\ and hence on {Q^idp) ^ 6*}, 

because (t;(r),r G ^[ep,6i^(0p)]) is a martingale family. 

Hence, by letting q tend to oo, 

E\v{B^{Bp)) I V„ JeJ = v{B-) a.s. on {^^(^p) ^ 0} n ^. 

Now, we have 

^b(0^(0p)) I V„ JeJ = ^b(0^(ep)) I a.s. on ^. 

It follows that 

E\v{e^{ep)) I Te-\ = v{e-) a.s. on {^^(0p) ^ 0} n ^. (27) 
By (24 1, we have^[t;(0^(0p)) I -Fe] = v{9) a.s. on {^^(^p) ^ ^}. Hence, by taking the condidional 



expectation with respect to J-g- , we derive that 

E[v{e^{ep))\j^g-] = E[v{e)\j^e-] <v{e-) a.s. on BnAn{e^{ep)^e}, 



which, with equality (27), yields that n ^4 n {6^{0p) ^ 6*} = a.s. □ 



Recall now that, by (23), for each AG [0, 1[ and for each p G N, we have 

Xvie^iOp)) ^ <p{e^{ep)) a.s. (28) 

From this property, we derive the following property. 
Lemma A. 4 — // (p is of class D, we have 

E[v{e-)lAnB] = sup limsnpE[^{0^{dp))lAnB]- 

Ae]0,l[ P-s>oo 

Also, for each D G J~0- , this equality holds with AdB replaced by An B f] D. 



Proof — From inequality (28), it follows that for each AG [0, 1[ and each p G N, 

XE[v{e\9p))lAnB] ^ E[^{e\ep))lAnB]. 
By letting p tend to +cxd, we derive that 

Alimsup^[w(^^(0p))lAni3] ^ limsup E[(t>{9\ep))lAnB]- 



Since {9'^{9p)f\6) announces 9 on Ar\B, by Proposition A.l it follows that lim„^.oo v{9'^{9p)/\9) 
v{9~) a.s. on Ar\ B. Using Fatou's lemma, we get 



E[v{9-)lAr.B]^\^TniniE[v{9\9p))lAnB\ ^liuisnp E[v{9\9p))lAnB\. 

p— !>oo p— >-oo 
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The two above inequalities yield that 

\E[v{e-)lAnB\ ^ limsupE[,^(^\^p))l^nB], 

and this holds for each A G [0, 1[. Hence, by taking the supremum over A g]0, 1[, we get 

E[v{d-)lAnB\ ^ sup \misu^E[ct>{e^{9p))lAr,B\. 

Ae]0,l[ P^oo 

The same arguments show that for each D G Fq- , this inequality holds with AClB replaced by 
AnBDD. 

At last, by using the inequality v ^ cp feet that v is of class V, we derive that the 

inequality is an equality. □ 
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